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Abstract 

The Technology Accentuated Teacher Education for Rural Specialists (TATERS) program aimed to: (a) prepare highly qualified special education teachers 
across a state comprised of more than 70% rural districts, (b) develop a system of support through a mentor network and institutions of higher educa¬ 
tion collaboration to address the needs of teacher candidates in rural areas, (c) ground special education teachers in the use of evidence-based practices 
to improve the instructional services that students with disabilities in Idaho receive, and (d) develop a mechanism to evaluate and provide feedback on 
teacher candidates’ implementation of evidence-based practices. This article describes the application of a special education teacher evaluation system 
to a teacher preparation program designed to improve special education teachers’ ability to implement evidence-based practices for students with dis¬ 
abilities in rural areas. Key program components are described and future directions for continuous improvement are highlighted. 
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Students with disabilities (SWD) are arguably the most 
difficult students to teach. They need individually designed 
instruction to meet their unique learning needs, and the de¬ 
livery of this type of instruction requires a highly trained, ana¬ 
lytical special education teacher who thoroughly understands 
the content or construct she is teaching, can assess where the 
student is in the learning progression, and effectively delivers 
instruction using methods that support the student’s learning 
needs. The effective use of evidence-based practices (EBPs) is 
a sophisticated iterative process, leading some to refer to spe¬ 
cial education instruction as a technical science (Odom et al., 
2005) that requires a high level of training and preparation 
of special education teachers. Unfortunately, SWD are more 
often served by a special education teaching force that is not 
well trained in the use of EBP, and that is highly subject to 
attrition and turnover (Billingsley, 2004; Boe, Cook, & Sun¬ 
derland, 2008; Connelly & Graham, 2009). 

Special education is consistently identified as a high 
demand field with positions filled by teachers who lack ad¬ 
equate preparation to meet the demands of the position (Boe 
et ah, 2008). This is especially the case in rural states such as 
Idaho, where special education has been identified as a high 
demand field for nearly three decades. The hard to fill nature 
of this position is not easily solved. The shortage of highly 
qualified teachers has led to an increased number of teach¬ 
ers accepting positions even though they are not qualified 
and then completing alternative routes to certification with 


various levels of quality. The net effect is a special education 
teacher workforce that has contributed to the poor academic 
outcomes for SWD. For example, recent estimates suggest 
that as little as 20% of a special education teacher’s time is 
dedicated to instruction (Vannest & Hagan-Burke, 2009) 
and that as few as 30% of SWD are able to meet performance 
standards (Odom, 2009). Consequently, ill-prepared teach¬ 
ers who are doing their best to learn ‘on the job’ then serve 
as ‘model’ teachers for candidates who are completing their 
special education teacher certification program. This means 
that many teacher candidates do not have access to one of the 
critical components of an effective teacher education system- 
strong field experiences where they are able to learn, practice, 
and receive feedback on their use of EBPs that support the 
needs of students with disabilities. Improving special educa¬ 
tion teacher practice requires a systems level change that in¬ 
cludes multiple components, including stronger special edu¬ 
cation teacher preparation programs that effectively produce 
teachers well-versed in implementing EBPs. 

Challenges of Teacher Preparation in Rural Districts 

Rural districts face many challenges. First, rural districts 
generally do not have ready access to universities, where they 
can collaborate with teacher education programs and hire 
promising graduates. Second, they have difficulty recruit¬ 
ing highly qualified teachers to move to rural areas because 
they cannot match pay, many people do not want to move 
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to rural areas, or they do not have strong professional sup¬ 
port systems and induction programs, including access to 
mentor teachers who are available to answer questions and 
to support the use of EBPs (Hardman, Rosenberg & Sindel- 
ar, 2005). To fill vacancies, rural districts must often resort 
to hiring teachers who are not certified (Menlove & Lignin 
garis/Kraft, 2004). These teachers either complete teacher 
training programs while they are busy with the demands of 
a new job or, in many cases, leave the profession before their 
emergency credential expires. The cycle of less than optimal 
instruction that is provided to SWD is difficult to break un¬ 
der these circumstances. 

Critical shortages of special education teachers exist 
in many areas of the nation but are especially pronounced 
in rural areas (Menlove & Lignugaris/Kraft, 2004), where 
filling positions is problematic. The need for highly skilled, 
well-trained special education teachers in rural areas to de¬ 
liver intensive, individualized instruction to support a child’s 
academic growth cannot be overstated. Classroom observa¬ 
tion studies repeatedly indicate that students do not always 
receive services that can reasonably be expected to mitigate 
the effects of their disabilities (Morgan, Frisco, Farkas & Hi- 
bel, 2008). Other researchers have found special education 
classroom instruction to be routine and generic to all stu¬ 
dents in the class, rather than intensive and individualized as 
articulated in each student’s IEP (Harry & Klingner, 2006). 
Recent classroom observations in rural districts indicate that 
low levels of EBP implementation is the norm; a collection 
of teacher observations used to validate a special education 
teacher observation tool indicated that 100% of participat¬ 
ing special education teachers were rated as basic or below 
on their use and implementation of EBP (Johnson & Sem- 
melroth, in press). 

As a result of the decreased access to regular, high-quality 
special education instruction, the academic achievement for 
SWD has either declined or not improved in spite of the 
range of evidence-based instructional practices that have been 
established in special education. Morgan et al. (2008) found 
that special education services from 2002-2004 had negative 
or statistically non-significant effects on young children’s 
reading and mathematics skills. Nationally, the non-achieving 
trend has held steady for the past decade, with average scores 
on the National Assessment of Educational Progress mea¬ 
sures ranging from 61% to 72% below the basic level for 4th 
and 8th grade SWD (US Department of Education, 2011). 

One way that the US Department of Education is seek¬ 
ing to remedy these challenges is through the Office of 
Special Education Program’s (OSEP) Personnel Preparation 
grants. These grants provide support to Institutions of Higher 
Education (IHE) to develop special education teacher train¬ 
ing programs that are innovative and responsive to the needs 
confronting K-12 schools. Through the personnel prepara¬ 
tion programs, IHEs are encouraged to ensure that EBPs are 
integrated in their teacher preparation coursework to produce 
highly qualified special education teachers who are ready to 
support the needs of SWD. 

Program Structure and Beneficiaries 

The OSEP funded special education teacher preparation 
program at Boise State University, Technology Enhanced 


Teacher Education for Rural Specialists (TATERS) was de¬ 
signed to help address several significant needs in Idaho: (a) 
Prepare highly qualified special education teachers across a 
state comprised of more than 70% rural districts, (b) develop 
a system of support through a mentor network and IHE col¬ 
laboration to address the needs of teacher candidates in 
rural areas, (c) ground special education teachers in the use of 
EBPs to improve the instructional services that students with 
disabilities in Idaho receive, and (d) develop a mechanism to 
evaluate and provide feedback on teacher candidates’ imple¬ 
mentation of EBPs so they enter the profession with the high¬ 
est possible skill level. 

The program was designed as a post-baccalaureate 
certification option that has since evolved into a graduate 
level Master’s in Teaching program. Graduates of our revised 
special education teacher preparation program included not 
only teacher candidates in the surrounding Boise area, but 
also 27 graduates serving in rural districts across the state of 
Idaho. 

Key Components of TATERS 

TATERS is guided by the critical features of effective 
teacher preparation programs outlined by Brownell, Ross, 
Colon and McCallum (2005) that includes: (a) a common 
and coherent vision of teaching and learning, (b) common 
and related strategies across courses, (c) integrated clinical 
experience with coursework, and (d) revisiting ‘big ideas’ con¬ 
tinuously throughout the program. The TATERS program is 
offered online over four semesters. In addition to the online 
coursework, teacher candidates complete intensive fieldwork 
each semester that is focused on supporting their application 
of the EBPs they learn in class to their K-12 classrooms. Over 
the 5 years of our program, we worked with a consistent set 
of supervising teachers and worked with the Idaho State De¬ 
partment of Education to develop a special education teacher 
mentor network. The specifics of our coursework and mentor 
program are outlined in more detail elsewhere (see Johnson, 
Humphrey, & Allred, 2009). 

In the first 2 years of the TATERS program, our focus 
was on the first three critical features (Brownell et al., 2005) 
listed above. In addition to having program level assignments 
that cut across courses (e.g. teacher candidates began the 
process of IEP development in the assessment course, then 
learned to develop goals and objectives in methods, behavior 
and transition courses), we also ensured the consistency of 
our online course design and format to allow our teacher can¬ 
didates to focus on content rather than having to learn how 
to navigate a new course set up. We also developed integrated 
field assignments designed to serve as complex performance 
assessments during which our teacher candidates synthesized 
and applied the specific information they learned to the K-12 
classroom setting. In the third year of our program, we real¬ 
ized that our teacher candidates needed more guided practice 
and feedback with EBP implementation and that we needed 
to develop an evaluation system to serve as a formative and 
summative assessment of candidate performance in their 
field experiences. Working with our state department of edu¬ 
cation, we developed a special education teacher evaluation 
system that we were able to apply to our preservice teacher 
candidates (Johnson & Semmelroth, 2014). 
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Evaluating Teacher Candidates’ Use of EBP 

Online coursework coupled with intensive field expe¬ 
riences is a common model for special education teacher 
preparation programs serving large geographical areas. Our 
concern as we continued with TATERS implementation was 
that many of our teacher candidates were working either in 
less than optimal placements (e.g., partnered with a teacher 
who had little or no training and experience in special educa¬ 
tion) or filling both the role of K-12 special education teacher 
and TATERS special education teacher candidate and, as a 
result were lacking sufficient practice and feedback on their 
implementation of various instructional practices. With the 
funding support from the OSEP 325T grant, we hired a pro¬ 
gram coordinator who maintained contact with our teacher 
candidates and conducted two observations each semester. 
Given that one of the goals of the OSEP personnel prepara¬ 
tion program is to ensure sustainability after grant funding 
ends, we needed to find a way to increase our ability to con¬ 
duct observations in a cost-effective way. 

To remedy this issue, we worked with the Idaho State 
Department of Education to develop a special education 
teacher evaluation system that included evaluation tools for 
pre-service, initial certification, and master special education 
teachers. The teacher evaluation tool we designed was called 
Recognizing Effective Special Education Teachers (RESET) 
and is described in more detail in Johnson & Semmelroth 
(2014). In brief, RESET relies on the observation of special 
education teachers’ instruction and, using rubrics that are 
aligned with EBP criteria, provides a rating of performance 
but, more important, provides specific and actionable feed¬ 
back on how to improve instructional practice. A significant 
body of research establishes a number of effective practices 
to meet the needs of SWD. Aligning the evaluation system to 
provide feedback on the specifics of these practices provides 
teachers the information needed to improve. RESET is based 
on the following principles: 

1. The system is grounded in Danielson’s framework 
with a focus on Domain 3: Instruction (Danielson, 
2007). In addition to evaluating common features of 
sound instructional practice, it includes much more 
clearly delineated criteria for evaluating evidence-based 
instructional practice appropriate for SWD. 

2. The evaluation system is computerized and uses video 
capture of a teacher candidate’s instruction. The video is 
evaluated by a faculty supervisor, the teacher candidate, 
and, when possible, the mentor teacher. 

3. Special education teacher candidates receive feedback 
according to the criteria derived from the research 
establishing instruction as evidence-based. 

4. The increased use of EBP will ultimately lead to 
improvements in outcomes for SWD. Teacher candidates 
monitor and report their students’ growth so that, 
over time, student growth and achievement might be 
used as a reasonable estimate of a teacher’s effective 
implementation of EBP. 

Our evaluation focused primarily on instruction because 
it is the single variable within a special education teacher’s 
control that most affects student outcomes. Drawing on the 
research on instructional practice to date, we identified com¬ 


mon elements of instruction, such as (a) building effective 
instruction based on rigorous expectations, (b) creating an ef¬ 
fective learner environment that is engaging, (c) making con¬ 
tent area knowledge relevant to the learner, and (d) providing 
learning experiences using effective research based strategies 
(Hattie, 2009). Next, we identified the specific instructional 
practices within special education that have been determined 
to be EBP. A significant body of research has established a 
number of effective instructional practices to meet the needs 
of students with disabilities (see, for example, Chard, Ketter- 
lin-Geller, Baker, Doabler, & Apichatabutra, 2009; Cook & 
Odom, 2013; Fuchs & Fuchs, 2005; Gersten et al., 2009; Na¬ 
tional Autism Center, 2009; Odom, 2009; Spooner, Knight, 
Browder, & Smith, 2012). This body of research guided the 
development of detailed rubrics used to evaluate practice and 
to provide guidance to teacher candidates. 

The conceptual framework guiding the use of RESET 
in teacher training programs is that, through a targeted, well- 
defined observation that incorporates clearly explicated cri¬ 
teria linked to EBPs in special education, teacher candidate 
attention will be targeted to those instructional practices that 
have been demonstrated to result in improved student out¬ 
comes. Through the use of this evaluation rubric, teacher can¬ 
didates are provided with explicit feedback on the components 
of instructional practices on which they need improvement. 
In addition, teacher candidates routinely collect, analyze and 
react to individual student data. When this practice is coupled 
with the use of RESET within the teacher preparation pro¬ 
gram, our teacher candidates begin to better understand the 
impact of their instructional practice on student outcomes. As 
an evaluation system for special education teacher candidates, 
the focus of RESET is on its formative rather than summative 
use. The observation system and feedback is designed to help 
our teacher candidates improve their instructional practice. 

Process of Teacher Candidate Evaluation 

As mentioned above, the focus of RESET was on its 
use as a formative assessment. Teacher candidates were re¬ 
quired to videotape a minimum of four lessons throughout 
the semester. Initially, we used the Teachscape video system 
(which was used as part of the development of RESET), but 
access to a limited number of cameras meant that we needed 
the ground staff to set up, operate, and capture the video 
recordings. As part of our sustainability efforts, we knew that 
continued reliance on Teachscape was not feasible and so 
elected to use lower cost alternatives for video capture, such 
as personal mobile devices (e.g., smartphone, iPad). Videos 
were then uploaded to a secure system, and viewed and evalu¬ 
ated asynchronously by the program coordinator and teacher 
candidate, with time allotted for synchronous, virtual debrief¬ 
ing meetings. 

The RESET tool produces a score when used to evaluate 
special education teachers, and ongoing work is examining 
cut scores and proficiency levels (Johnson & Semmelroth, 
in press). When applied to special education teacher candi¬ 
dates, we did not assign score values, relying only on the use 
of feedback on the specific instructional components. Our 
decision to avoid the use of scores with our candidates was 
intentional. The RESET scoring system is still being validat¬ 
ed, and therefore, we did not want to make decisions about 
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candidate performance using flawed data. In addition, our 
goal in using RESET was to provide multiple opportunities 
for a teacher candidate to practice and receive feedback on 
their implementation of an EBR We were concerned that as¬ 
signing a score would take the emphasis away from improving 
practice and place it on trying to ‘pass a test.’ Finally, one of 
the values of our program is engaging in continuous improve¬ 
ment. Our goal with repeated observation was to instill this 
value into our teacher candidates as a lifelong professional 
practice. 

The feedback session was individualized to address each 
candidate’s specific needs. However, we followed a common 
format and framework for guiding the discussion. First, we 
asked the candidate to discuss their self-evaluation. The ru¬ 
bric criteria served as a common and consistent reference for 
teacher candidates and allowed them to focus their thoughts 
and discussion. Next, the supervising faculty provided their 
evaluation. Discrepancies in the evaluation were discussed to 
ensure common understandings. When available, the mentor 
teacher also engaged in this process. Each feedback session 
was concluded with a ‘next steps’ list of specific, actionable 
items for the teacher candidate to work on, and these items 
were reviewed in the subsequent session. 

Program Outcomes and Next Steps 

We did not begin the use of RESET in our TATERS pro¬ 
gram until the fourth year of implementation. Prior to that, 
our state did not have a special education teacher evaluation 
system, and, as a department, we were still updating course- 
work, establishing relationships with coordinating sites, de¬ 
veloping our mentor network system, and devising the evalu¬ 
ation system. Therefore, our current data on the use of the 
RESET system within our teacher preparation program is still 
anecdotal in nature, as it is based on information collected 
from 10 special education teacher candidates. However, the 
information collected to date provides important feedback 
for other programs considering the use of similar models and 
for determining next steps. 

Teacher Candidate Response to Evaluation Systems 

Our teacher candidates responded very favorably to the 
video-recorded observation and feedback of their instruction¬ 
al practice. Nearly all of our candidates indicated that observ¬ 
ing themselves on video was one of the most effective instruc¬ 
tional processes used in our TATERS program. In addition, 
they noted that the use of rubrics outlining the key elements 
of an EBP were especially helpful in guiding their practice. 
The rubrics provide a concise guide that mirrored what they 
learned in coursework so that they could understand how the 
instructional method should be translated into practice. The 
cohort of teacher candidates who used video observations 
and feedback via RESET took ownership of the process as the 
semester continued, oftentimes being able to identify with 
minimal input from program staff the instructional practices 
that were effective and areas that needed continued refine¬ 
ment. 

Faculty Response to Evaluation Systems 

To date, only two program staff have routinely used video 
observations and feedback provided via RESET. While the 


initial set up and process can seem cumbersome, over time, 
both program staff indicated that the significant advantage 
in using RESET to evaluate candidate performance was the 
analytic and reflective focus it brought to the observation ses¬ 
sions and, as a result, the significant improvement in teacher 
candidate performance that was realized. In addition, the fo¬ 
cus on ensuring that teacher candidates mastered EBPs con¬ 
tributed to a revision of the program with increased emphasis 
on the use of a concentrated set of EBPs designed to meet the 
needs of many SWD; thus, teacher candidates who enter the 
program will be trained to effectively implement a core set of 
EBPs and then expand their repertoire through professional 
practice and the state’s tiered licensure professional develop¬ 
ment requirements. 

The use of the evaluation system helped to connect 
multiple components of our special education teacher 
preparation system. First, by aligning our teacher candidate 
observation system with a tool that will be used by the state 
to evaluate them as practicing teachers, we are able to focus 
the IHE’s role in the teacher preparation process, ensuring 
that our graduates are prepared to meet the demands of their 
new positions. In addition, the use of the observation tool to 
evaluate practice served as a way for faculty to bring together 
the elements of our program and provide a performance as¬ 
sessment that addresses all of the competencies our special 
education teachers need to demonstrate into a complex 
performance assessment. Finally, as a means for addressing 
current quality concerns in existing special education class¬ 
rooms, RESET holds promise. In two classrooms in which we 
used RESET, the mentor teachers benefitted from the pro¬ 
cess. Both teachers requested that we use RESET to observe 
and provide feedback on their instructional practices. 

Conclusions 

Special education is a high demand field, with many 
positions either vacant or filled with unqualified personnel 
(Billingsley, Fall & Williams, 2006; Boe & Cook, 2006). 
Special education teacher preparation programs often do not 
integrate the use of EBPs, leaving new teachers ill-prepared 
to meet the challenges of the classroom (Reschly, Holdheide, 
Smart & Oliver, 2007). Historically, special education has 
been characterized by high attrition rates (Holdheide, Goe, 
Croft, & Reschly, 2010; Sindelar, Brownell, & Billingsley, 
2010) and personnel who are not fully certified or certified 
through alternate routes (Littrell, Billingsley, & Cross, 1994; 
McLeskey, Tyler, Saunders, & Flippin, 2004). These factors 
lead to a profession chronically faced with teacher shortages, 
as evidenced by surveys in which more than 95% of all US 
school districts reported at least one teaching vacancy in the 
field of special education at the beginning of the school year 
(Connelly & Graham, 2009). Given the increase in students 
receiving special education of over 30% in the past decade, 
the problem continues to grow. The combination of these 
challenges has contributed to the “substandard quality of 
education for students with special needs” (CEC Launches 
Initiatives on Special Education Teaching Conditions, 1998, 
as cited by Gersten, Keating, Yovanoff, & Harniss, 2001, p. 
549). 

Teacher preparation programs can serve as an effective 
tool in remedying the challenges that the special education 
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field confronts. Through the implementation of a teacher 
candidate observation system that both informs and evaluates 
teacher candidates on their use of evidence-based instruc¬ 
tional practices, special education teacher candidates will 
be provided ongoing opportunities to develop competency 
with their work. Over time, the system can encourage special 
education teacher programs to prioritize and teach the use 
of instructional practices that are most likely to bring about 
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